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Abstract 

We prove a non-stochastic version of Levy's zero-one law, and deduce several 
corollaries from it, including non-stochastic versions of Kolmogorov's zero-one 
law, the ergodicity of Bernoulli shifts, and a zero-one law for dependent tri- 
als. Our secondary goal is to explore the basic definitions of game-theoretic 
probability theory, with Levy's zero-one law serving a useful role. 
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1 Introduction 



In this article, we prove a game-theoretic version of Levy's zero-one law. It 
applies in situations where standard statements of Levy's zero-one law ([7], 
Section 41) do not apply, because we do not postulate a probability measure on 
outcomes. This is typical for game-theoretic probability: see, e.g., [SJ. Upper 
and lower probabilities do emerge naturally in prediction protocols considered 
in game-theoretic probability, but in many cases lower probabilities are strictly 
less than the corresponding upper probabilities, and so they fall short of defining 
a probability measure. 

The investigation of zero-one laws of game-theoretic probability was started 
in [5] . From our game-theoretic version of Levy's zero-one law we deduce game- 
theoretic versions of Kolmogorov's zero-one law ([5J, Appendix), the ergodic- 
ity of Bernoulli shifts (see, e.g., [3], Section 8.1, Theorem 1), and Bartfai and 
Revesz's pQ zero-one law. The first two results have been established in [9], but 
our proofs are different: we obtain them as easy corollaries of our main result. 

We start our exposition in Section [2] by introducing our basic prediction 
protocol and defining the game-theoretic notions of expectation and probability 
(upper and lower) ; these definitions are explored in Section [3] In Section [4] we 
prove Levy's zero-one law for this protocol. In the second part of Section [I] 
we consider the special case of an event whose upper probability coincides with 
its lower probability; our version of Levy's zero-one law for such events looks 
much more similar to the standard statement. Section [5] describes a useful 
application of Levy's zero-one law to the foundations of game-theoretic prob- 
ability theory. In Section [6] we derive two other non-stochastic zero-one laws 
(Kolmogorov's zero-one law and the ergodicity of Bernoulli shifts) as corollar- 
ies. In Section [7] we explain that our prediction protocol covers as special cases 
seemingly more general protocols considered in literature. This helps us to de- 
rive a non-stochastic version of one more zero-one law (Bartfai and Revesz's) in 
Section El 

We will be using the standard notation N = {1,2,...} for the set of all 
natural numbers and K = (— oo, oo) for the set of all real numbers. Alongside K 
we will often consider sets, such as (— oo, oo] and R := [— oo, oo], obtained from 
R by adding — oo or oo (or both). We set x oo :— and oo + (— oo) := oo 
(the operation + extended to R by oo + (— oo) := oo is denoted by + in [5]; in 
this article we will omit the dot in + since we do not need any other extensions 
of +). The indicator function of a subset E of a given set X will be denoted 
Ie; i.e., Ie '■ X — > R takes the value 1 on E and the value outside E. The 
words such as "positive" and "negative" are to be understood in the wide sense 
of inequalities > and < rather than > and <. 

2 Game-theoretic expectation and probability 

We consider a perfect-information game between two players called World and 
Skeptic. The game proceeds in discrete time. First we describe the game for- 
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mally, and then briefly explain the intuition behind the formal description. 

Let X be a set, and let M. x stand for the set of all functions / : X — > R. 
A function £ : M. x — s> R. is called an outer probability content if it satisfies the 
following four axioms: 

1. If f,g € R x satisfy f < g, then £ (/) < £ (g). 

2. If / e I x and c € (0, oo), then £ (cf) = c£{f). 

3. If f,g€R x , then £(/ + <?)<£(/)+ £(<?). 

4. For each c € R, £(c) = c, where the c in parentheses is the function in M. x 
that is identically equal to c. 

The function £ is called a superexpectation functional (or superexpectation for 
brevity) if, in addition, it satisfies the following axiom (sometimes referred to 
as a-subadditivity on [0,oo] x ). 

5. For any sequence of positive functions /i, /2, • • ■ in R^ , 

/ oo \ oo 

£\Yjk)<Yj(fk)- a) 




Replacing the = in Axiom[2]with < leads to an equivalent statement because, 
for c € (0, oo), £ (cf) < c£(f) = c£((l/c)cf) < £(cf). In presence of Axiom[l] 
we can allow c G R in Axiom [4] without changing the content of the latter. 
Axiom [4] implies £(0) — (so that we can allow c = in Axiom [2J. This, in 
combination with Axiom [l] implies 

/ > £{f) > 0. (2) 

Axioms [3] and [4] imply that 

£(f + c)=£(f)+c (3) 

for each eel (indeed, £ (/ + c) < £(/) + £ (c) = £ (/) + c and £(/) < £(/ + 
c) + £ (-c) = f (/ + c) - c). From ^ and (|| we can see that, for any c € R, 

£(/) < c ini < c. (4) 
Axioms 1-5 are relaxations of the standard properties of the expectation 



and [3] are weaker than the 
are stronger than the corre- 



functional: cf., e.g., Axioms 1-5 in [II: (Axioms 
corresponding standard axioms, Axioms [T] and I 
sponding standard axioms but follow from standard Axioms 1-4, and Axiom [5] 
follows from standard Axiom 5 in the presence of our Axiom [3]). 

The most controversial axiom is Axiom [5] It is satisfied in many interesting 
cases, such as in the case of finite X and for many protocols in S|. Axiom [5] is 
convenient and often makes proofs easier. However, most of the results in this 
article hold without it, as pointed out by a referee. For our principal results, 
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we first prove them assuming Axiom [5] but then give an additional argument to 
get rid of the reliance on it. 

The most noticeable difference between what we call superexpectation func- 
tionals and the standard expectation functionals is that the former are defined 
for all functions / : X — > M whereas the latter are defined only for functions 
that are measurable w.r. to a given tr-algebra. The notion of superexpectation 
functional is more general since every expectation functional can be extended 
to the whole of M. x as the corresponding upper integral. Namely, £(f) can be 
defined as the infimum of the expectation of g (taken to be oo whenever the 
expectation of max(g, 0) is oo) over all measurable functions g > /. The exten- 
sion may no longer be an expectation functional but is still a superexpectation 
functional. 

Superexpectation functionals have been studied in the past in many different 
contexts under different names; in our terminology we mainly follow [5] , except 
that we abbreviate "outer probability content cr-subadditive on [0, oo] x " to "su- 
perexpectation functional" . Upper previsions studied in the theory of imprecise 
probabilities are closely related to superexpectation functionals, one difference 
being that upper previsions are only defined on the bounded functions in R x . 

Remark. It is sometimes useful to have the stronger form 

/>0=^£(/)>0 (5) 

of p|. Even the strong form ^ follows from Axioms [l}{5j Indeed, if / > but 
£{f) = 0, Axioms [l}[5] imply 

1 - £ ( I {/>o>) = £ (Xj~ =1 {t./>i}) < £ (^2 W>1}1 

[hi 00 m 00 

n— 1 n— 1 

(over each relation symbol we write the ordinal number of the axiom that jus- 
tifies it; we could avoid using Axiom [2] by using ([2| and Axiom [3] instead). 

The main prediction protocol that we consider in this article is as follows. 

Protocol 1. Basic prediction protocol 
Parameters: non-empty set X 

and outer probability contents £ i , £ % , . . . on X 
Protocol: 

Skeptic announces /Co €E K. 
FOR n= 1,2,...: 

Skeptic announces f n € M. x such that £ n (f n ) < /C n _i. 

World announces x n G X. 

^Wi ■ In («£n ) ■ 

END FOR 
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The set X will be called the outcome space; this set and the other parameters 
of the game (namely, the outer probability contents £1,82, ■ ■ ■ on X) will be 
fixed until Section [JJ An important special case is where £ 1 , £ 2, ■ • • are super- 
expectations on X, but as we said, our principal results will not require this 
assumption. 

At the beginning of each trial n Skeptic chooses a gamble represented as 
a function /„ on X. After that World chooses the outcome x n of this trial, 
which determines the payoff f n (x n ) of Skeptic's gamble. The gambles available 
to Skeptic at trial n are determined by £ n . Skeptic's capital after the nth trial 
is denoted K, n . He is allowed to choose his initial capital ICq and, implicitly, also 
allowed to throw away part of his capital at each trial. Our definitions imply 
that Skeptic is allowed not to play at trial n (and thus keep his money intact) 
by choosing /„ = K n ^\ (cf. Axiom [2]). Property Q reflects what is sometimes 
called the "coherence" of the protocol; in its absence the protocol becomes a 
money machine for Skeptic. (See also Lemma [I] below.) Protocol 1 covers the 
apparently more general case where the superexpectations £ n are not fixed in 
advance but chosen by a third player: see Section [7] below. 

Remark. In [3] we considered a different but essentially equivalent prediction 
protocol ([2], Protocol 2). For connections with Peter Walley's theory of impre- 
cise probabilities, see the recent article [4]. 

We call the set fl := X°° of all infinite sequences of World's moves the sample 
space. The elements of the set X* := U^Lo °f an finite sequences of World's 
moves are called situations. For each situation s we let T(s) C Q stand for the 
set of all infinite extensions in fl of s (i.e., T(s) is the set of all to G O such 
that s is a prefix of w). Let □ be the empty situation. If s is a situation and 
x G X, sx is the situation obtained from s by adding x on the right; therefore, 
SX — X 1 . . . X ji X when s = X\ . . . x„. If s and t are two situations, we write sC( 
when s is a prefix of t, and we write s G t when sCi and s 7^ t. We will also 
be using derived notation such as s C u C t, s % t, and s D t. 

The length \s\ of a situation s G X n is n (i.e., |s| is the length of s as a finite 
sequence); in particular, |D| =0. If oj G fi and n £ {0, 1, . . .}, oj n is defined to 
be the unique situation of length n that is a prefix of u. For lo = x\Xi . . . G f2 
and n G N, we let uj n G X stand for x n . 

A strategy E for Skeptic is a pair (E , Ex), where E G K (informally, this is 
the initial capital chosen by Skeptic) and Ei : X* — > M. x is a function satisfying 
£i(Ei(D)) < E and £ n (Ei(sx)) < E x (s)(x) for all n > 2, s G X n ~ 2 , and x G X 
(informally, for each situation s, Ei(s) is the function chosen by Skeptic in 
situation s). If we fix a strategy E = (Eo, Ei) for Skeptic, his capital K, n becomes 
a function of the current situation s = x\...x n of length n. We write /C s (s) 
for K n resulting from Skeptic following E and from World playing s. Formally, 
the function /C s : X* ->• I is defined by /C S (D) := E and /C s (sx) := Ei(s)(x) 
for all s G X* and all x G X. This function will be called the capital process of 
E. A function S is called a (game-theoretic) supermartingale if it is the capital 
process, S = KP , of some strategy E for Skeptic. 
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Notice that a function S is a supermartingale if and only if S : X* — > E and, 
for all n £ N and all situations s £ A"™ -1 of length n — 1, 

£„($(*■)) <s(«), 

where, as usual, <S(s •) : A — > R is the function mapping each x £ X to S{sx). 
A supermartingale 5 is a martingale if £„(<S(s-)) = <S(s) for all n € N and 

Remark. Martingales are less useful for us than supermartingales since the 
sum of two martingales may fail to be a martingale (the inequality in Axiom [3] 
may be strict), whereas the sum of two supermartingales is always a super- 
martingale. Under Axiom [5] even a countable sum of positive supermartingales 
is a supermartingale. 

The following useful property of supermartingales follows easily from Q. 

Lemma 1. For each supermartingale S and each situation s, 

Sis) > inf S(uj), 
wer( s ) 

where S(uj) is defined to be limsup^^^ S(uj n ) for all u £ Q. 

Proof. Let s = Xy . . . Xk £ X k and let r > S(s) be given. Since £k+i(S(s •)) < 
S(s) < r, by Q there exists Xk+i £ X such that S(x% . . .Xk+i) < r. Repeating 
the argument we can find Xk+iXk+2 ■ ■ ■ such that S{x\ . . . x n ) < r for all n > k. 
Setting u := x\Xi . . ., we have to £ T(s) and S(u> n ) < r for all n > k. This 
completes the proof. □ 

For each function £ : — > R and each situation s, we define the (conditional) 
upper expectation of £ given s by 

E(£ | s) := infja | 3S : S(s) = a and 

liminf S(u n ) > £(w) for all u £ T(s)\ (6) 

where S ranges over the supermartingales that are bounded below, and we define 
the lower expectation of £ given s by 

E(£ | «):=-!(-£ | s). (7) 

If E is any subset of Q, its upper and lower probability given a situation s are 
defined by 

F(E | a) := E(l E \ s), F(E \ s) := E(l E \ s), (8) 
respectively. In what follows we sometimes refer to sets E C 17 as events. 

Lemma 2. For each situation s, E(- | s) : M° — » R is an outer probability 
content. 
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Proof. It is evident that Axiom [I] is satisfied for E(- | s). Axiom [3] for E(- | s) 
follows from the fact that, by Axiom [3] applied to £i,£ 2 , ■ ■ ■, the sumW := S + T 
of two bounded below supermartingales S and T is again a bounded below 
supermartingale and that it satisfies 

liminfS(cj") +liminf T{uJ n ) < liminf U(ui n ) 

n— >oo n— foo n— >oo 

for all w G r(s). In the same manner, we can use Axiom [2] applied to £\, £2, ■ ■ ■ 
to deduce that E(- | s) satisfies Axiom [2j Let c € R. Since the function on 
M. x that is identically equal to c is a supermartingale, E(c \ s) < c. Let <S 
be a bounded below supermartingale satisfying liminf„_ s . 00 <S(w") > c for all 
uj € T(s). By Lemma [l] we then have <S(s) > c. Therefore, E(c | s) > c, which 
completes the proof of Axiom [4] for E(- | s). □ 

Lemma [2] immediately implies the following statement (cf. [5], (5.4)). 

Corollary 1. For all situations s and all functions £ : ft — > R, E(£ | s) < E(^ | 

s). In particular, V(E \ s) < P(_B | s) /or aiZ events E C fL 

Proo/. Suppose E($ | s) > E(£ | s), i.e., E(^ | s) + E(~£_ \ s) < 0. By Axiom [3] 
applied to E(- | s) this implies E(0 | s) < 0, which contradicts Axiom [4] for 
E(- I s). □ 

Important special cases are where s = □ (unconditional upper and lower 
expectations and probabilities). We set E(£) := !(£ | □), E(£) := E($ | □), 
F(E) := P(£ I □), and F(E) := P(E \ □). We say that an event E is almost 
certain, or happens almost surely (a.s.), if P(E) = 1; in this case we will also 
say that E, considered as a property of w e fl, holds for almost all uj. More 
generally, we say that E holds almost surely on B (or for almost all ui € B), for 
another event B, if the event (B =>■ E) := (B c U E) is almost certain. An event 
E is almost impossible, or null, if P(_B) = 0. 

In [8] we defined the lower probability of an event E as 1 — P(_E C ). The 
following lemma says that this definition is equivalent to our current definition. 

Lemma 3. For each event E C f2 and each situation s, 

F(E I s) = 1 -P(£; c I s). 

Froo/. By (|3| and Lemma[2j we have E(£ + c | s) = E(£ \s) + c for all f : fl ->• R 
and c € R. Therefore, 

P(£|.s)=E(I B |.s) = -E(-I B | S ) 

= 1 - 1(1 - I E I s) = 1 - E(Iec I s) = 1 - F{E C I s). □ 

The following lemma will be used in the proof of Lemma [5] stating that 
upper expectation is a superexpectation functional in the case where £ 1 , £ 2, ■ ■ ■ 
are superexpectation functionals. 
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Lemma 4. The right-hand side of ^ will not change when T(s) is replaced by 

n. 

Proof. It suffices to prove that if a bounded below supermartingale S satis- 
fies S(s) < r and liminf^oo S(u n ) > £(<j) for all u G T(s), then there ex- 
ists another bounded below supermartingale S' that satisfies S'(s) < r and 
liminfn^oo S'(u> n ) > £(w) for all uj £ ft. Such an S' can be defined by 

I oo otherwise. 

Lemma 5. Suppose £1,82, ••■ are superexpectations, and let s be a situation. 
Then E(- | s) is afao a superexpectation. In particular, for any sequence of events 
Ei, E2, ■ ■ ., it is true that 



\jE k ) <£p(£; fe ) 



\fe=i / fe=i 

In particular, the union of a sequence of null events is null. 
Proof. In view of Lemma [2j our goal is to prove 



\fe=l / k=l 

where £i,£2i • • • are positive functions in Mr. Let e > be arbitrarily small. For 
each fceN choose a supermartingale S k (automatically positive, by Lemma [I]) 
such that liminf„ <Sfc(w™) > ^(w) for all uj e 57 (cf. Lemma [4]) and 5fc(s) < 
E(£fc I s) + e/2 fc . Since all £ n are superexpectations, the sum S := X^fcLi $k 
will be a supermartingale (cf. Q); this supermartingale will satisfy <S(s) < 
SfcLi ^(£fc I s ) + 6 an dj by Fatou's lemma, 

CO 00 00 

liminf S{uj n ) = hminf S k (w n ) > V hminf S k (oj n ) > V( t (w) 
n n ' ^ * ^ n ^- — ' 

fc=l fe=l fc=l 

for all cj G Q. Therefore, 

(00 \ 00 

fe=i / fe=i 

It remains to remember that e can be taken arbitrarily small. □ 



3 Equivalent definitions of game-theoretic ex- 
pectation and probability 

The following proposition, which is our main statement of equivalence, gives 
two equivalent definitions of upper game-theoretic expectation. 



7 



Theorem 1. For all £ : — > K and all situations s, 

E(£ | s) = inf{«S(s) | limsupS(u/ 1 ) > £(w) for all uj G L(s)j 

('i.e., o?i i/ie right-hand side of |6p we can replace lim inf by lim sup,) and 

E(£ | s) inf {Sis) | Vuj G T(s) : lim 5(w n ) > £(uj)) 

where S ranges over the class L of all bounded below supermartingales for which 
limn^oo S(uj n ) exists in (— oo, oo] for all uj € Q. 

Proof. Let a bounded below supermartingale S satisfy the inequality 
Vw € r(s ) : limsup<S(u;™) > 

(cf. ([6])) and let e € (0, 1). It suffices to show that there exists S* G L such that 
5*(s ) < 5(s ) + e and Vu; G T(s Q ) : lim S*(u; n ) > f (w). (9) 

n— f oo 

Setting 5' := (<S> — C)/(S(so) — C), where C is any constant satisfying C < infS, 
we obtain a positive supermartingale satisfying S'(s ) = 1- 

The idea is now to use the standard proof of Doob's convergence theorem 
(see, e.g., [5], Lemma 4.5). But first we need to give more definitions, which 
will also be used in the proof of Theorem [2j 

If s and t are two situations such that s C £, we define the "intervals" 

[s,i] :— {u | s C u C t}, [s,i) := {u \ s C u C t}, 

(s, t] := {u | s C u C i}, (s, i) := {u | s C u C t}. 

Two situations s and t are said to be comparable if s C t or t C s; otherwise they 
are incomparable. A cu£ is a set of situations that are pairwise incomparable 
(cuts are analogous to stopping times in measure-theoretic probability). If a 
and r are two cuts, we write a < r to mean that s C t whenever s G cr and 
t G t are comparable. In this case we define the "time intervals" 

[a, t] := {u | [□, u] n cr ^ 0, [□, u) n r = 0}, 
[cr, r) := {w | [□, u] n cr ^ 0, [□, u] n r = 0}, 
(a, t] := {u | [□, u) n cr ^ 0, [□, it) n r = 0}, 
(cr, r) := {w | [□, u) n cr ^ 0, [□, u] n r = 0}. 

If s is a situation and r is a cut, s r stands for the unique (when it exists) 
situation (£t such that tCs. Similarly, if u) € f2 and t is a cut, w T stands for 
the unique (when it exists) situation t G t that is a prefix of uj. (The case where 
w T does not exist is analogous to the case where a stopping time takes value oo 
in measure-theoretic probability.) Notice that our notation of 1 for n = 0, 1, . . . 
can be regarded as a special case of the new notation: we can interpret the 
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upper index n as the cut consisting of all situations of length n. We will also 
be using the notation s n , where n = 0, 1, . . . and s is a situation, in the same 
sense. 

Let [oj, bi], i = 1,2,..., be an enumeration of all intervals with < a, < bi 
and both end-points rational. For each i one can define a positive supermartin- 
gale S l with 6*(s ) = 1 such that 6 l (w") converges to oo as n — >■ oo when 
liminf„ S'(uj n ) < <n and limsup„ S'(ui n ) > bi. The construction of 6 l is stan- 
dard. First we define two sequences of cuts Tq, t|, . . . and crj, a"|> • • ■ by setting 
Tq := {s } and, for k = 1, 2, . . ., 

o-^ : = { s | 5'(s) > 6 4 ,3i C s : f G Tjj^Vu G (i,s) : 5' (it) < 6J, 
:= {s | S'(s) < ai,at C s : t G o l k ,\lu G (t,s) : 5' (it) > aj. 

Now we define S 1 by the requirement that, for all situations s 2 so & n d all 
a; G A", 

4 /5 l ( S )+5'( Sa; )~5'( S ) if5' i ( S )<cx)and3fc: S e[r^ 1 ,^) 

I 6 (s) otherwise; 

in conjunction with S i (s ) — 1 this determines 6* uniquely on the situations 
s 3 s . If s ^ s , set S t (s) := oo. We have £ n (S l (s-)) < 6*(s), where 
n := |s| + 1, in both cases considered in ( |10[ ); e.g., since 6' is a supermartingale, 

£„(6*( S •)) = £n(S l (s) + S'(s ■) - S'(s)) < S*(s) 

when 5 I (s) < oo and 3k : s G [t^, 

Let us check that each supermartingale 6 1 is positive. There are three (over- 
lapping) cases: 

• If s G 

S l (s) > S'(s) > 

(we write 5 l (s) > S'(s) rather than S l (s) = S'(s) because of the possibil- 
ity that S'(s) < oo but S'(t) = oo for some t C s). 

• If s e [ffe, Tfe] for some fc = 1, 2, . . ., 

6 4 ( S ) > 1 + (6'(s CT *) - S'( So )) + (6'( S ^) - 6V 1 )) 

+ •■• + (6'( S CT *)-6'( S T *-0) >fci + (A-l)(6j-Oi)>0. (11) 

• If s G [r|, <7fc +1 ] for some fc = 1, 2, . . ., 

S*( s )>l+(S'( S ^)-S'( SQ )) + (S'( S ^)-S'(s^)) 

+ •••+ (6'( s <)-6'(s r ^0) + (6'(s)-6'( s r *)) 

> 6i + (*-!)(&<- a,-) + 5* (sJ-a^fcfo-Oi) > 0. (12) 
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Equations ( 11 ) and ( 12 ) also show that <S* {of 1 ) indeed converges to oo as n — > oo 
whenever liminf„ S'(oj n ) < a,i and limsup„ S' (uj n ) > bi for lo G T(sq). 
Now we can set 

oo 

T :=J2 2 ~ l S l ( 13 ) 

i=l 

and S* := S + eT- Assume, for a moment, that 81,82, - ■ ■ are superexpecta- 
tions. In this case T, being a countable sum of positive supcrmartingales, is a 
positive supermartingale itself. Being a sum of two supcrmartingales, S* is a 
supermartingale itself. 

Let us check that S* € L; this will imply the second inequality in ([9| (the 
first inequality holds by the definition of S*). Since S* is bounded below, we 
are only required to check that S*(uj n ) converges in (—00, 00] as n — > 00 for all 
oj G Q. Fix lj G Q. 

If S(oj n ) = 00 for some n, there exists i such that S l (ui n ) — 00 from some n 
on (take any i such that Oj = and bi > maxfc <n S'(u> k ), where n is the smallest 
number such that S(oj n ) — 00), and so we have T{uJ n ) = 00 and S*(uj n ) = 00 
from some n on. Therefore, we will assume that S(cj n ) < 00 for all n. 

If S(oj n ) converges to 00, S*(ui n ) also converges to 00. If S(uj n ) (and, there- 
fore, S'(u) n )) does not converge in (—00, 00], there exists i such that S z (uj n ) — > 00 
(take any i satisfying liminf„ S'(uj 71 ) < cii < bi < limsup n S'(uj n )), and so we 
have T(oj n ) — > 00 and S*(u! n ) —> 00. It remains to consider the case where 
«S(w n ) converges in E. 

Suppose S(uj n ) and, therefore, S'(uj n ) converge in K but S*(oj n ) does not 
converge in (—00,00]. Choose a non-empty interval (a,b) C R such that 
liminf nl S*(w") < a < 6 < limsup n 5*(w™) and set c:=b- a. Take any JVeN 
such that S*(lu n ) > b and \S(oj n ) - S(uj m )\ < c/2, \S'(oj n ) - 5'(a; m )| < c/4 for 
all n,m > N . Since 5'(w") - <S'(w m ) > -c/4 for all n, m > N, we will have 

S i (u n )-S i (bJ N )>-c/2 (14) 

for all i and all n > N. Indeed, there are five cases (overlapping): 

• If lu n G [c/,t/] for some I = 1,2,... and u" G [ct^jT^] for some k = 
1,1 + 1,...: 

S l {uj n ) - S\uj n ) = (V(cj ff,Vl ) - S'(u T 'i) + - 5'K'+i)) 

+ "- + (5'(w <7 *)-5 / (w T *-0) > (k-l)(bi-Oi) > 0. 

• If w w G [ct;,t ; j ] for some I = 1,2,... and ui n G [t^,(t^ +1 ] for some k = 
1,1 + 1,...: 

S\uj n ) - S\uj n ) = (S'(uj a '+^) - S'(u} T ')) + (s'(u°1+2) - 5'(o; r '+i)) 

+ • • • + (s'(uj<) - + (5'K) - S'(w T *)) 

> (fc-0(6i-ai)-c/4> -c/4. 
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If u) N € [ T i-i> a i] for some I = 1,2, .. . and w™ € [cj^T-fc] for some fc = 
/./ • 1....: 

S l {u: n )-S\Lu N ) = (S'(^) -S'(oj n )) + (>(cj ct '+i) -5'(w T ')) + 

_ 5'(w T '+i)) + ■ • • + - 

> -c/4 + (fc - ~ a t ) > -c/4. 

If cj^ 6 [ T ;-i! <T /] f° r some / = 1,2,... and of 1 E [ T ki a k+i\ f° r some 
k = 1,1 + 1,...: 

S l (uj n ) - S 1 {lu n ) = (s'(u a i) - S'(oj n )) + (S'(u)"i+i) - S'(u T ! )) 
+ (S'{uj a >+i) - S'(uj t '+^ +■■■+ (s'(uj^) - S'(u;^-i)) 
+ («S'(a; n ) - <S'(w r *)) > -c/4 +(k- l)(bi - a,) - c/4 > -c/2. 

If € [r/_ x , cr, 1 ] for some 1 = 1,2,...: 

S l (ui n ) - 5'(/) = S'(u n ) - > -c/4. 



In all five cases we have (14). This implies T(w n ) — T(uj n ) > —c/2, and so 
S*{uj n ) - S*(u N ) > -c for all n > N (remember that e < 1). The latter 
contradicts the fact that S*(lu ti ) — S*(u> N ) < — c for some n > N (namely, for 
any n> N satisfying S*(ui n ) < a). 

This completes the proof in the case where £ 1 , £2 , • ■ • are superexpectations. 
However, we do not really need Axiom [5} despite the appearance of an infinite 



sum in (13), for each situation s and each x £ X the increment T(sx) — T(s) 



of T can be represented (assuming T(s) < 00) as 

00 / 00 \ 

T(sx) - T(s) = 2~ l (S l ( S x) - 5*(a)) = I $>i ( 5 '( sa; ) ~ 5 '( s ))' 



i=l 



where Wi 6 {0, 2 '} (this makes the series YliLi w i convergent in K) are defined 
by 

'2- if3k-.se H^al) 
otherwise. 



Wi :- 



Since 5' is a supermartingale, £\ s \ + x(T(s ■) — T(s)) < 0. This argument for T 
being a supermartingale does not depend on Axiom [5] □ 

Replacing the lim inf in ([6| by inf „ or sup ra does change the definition. 
If we replace the liminf„_ i . 00 by inf„, we will have E(£ | s) — sup^gp^) £(w). In 
the following example we consider replacing liminfn^oo by sup n . 
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Example 1. Set 

:= inf I S(p) | e n : sup5(w") > f (w) 



5 ranging over the bounded below supermartingales. It is always true that 
Ei(£) < E(£). Consider the coin-tossing protocol (|8j, Section 8.2), which is the 
special case of Protocol 1 with X = {0, 1} and £„(/) = (/(0) + /(l))/2 for all 
n G N and / g M. . For each e € (0, 1] there exists a bounded positive function 
£ on ft such that E(£) = 1 and E~i(£) = e. 

Proof. Let us demonstrate the following equivalent statement: for any C > 1 
there exists a bounded positive function £ such that Ei(£) = 1 and E(£) = C. 
Fix such a C. Define E : fi — > [0, oo] by the requirement S(w) := 2" where n is 
the number of Is at the beginning of uj: n := max{z | u}\ = • • • = 0Ji = 1}. It is 
obvious that Ei(H) = 1 and E(H) = oo. However, S is unbounded. We can al- 
ways find A > 1 such that E(min(S, A)) — C (as the function a E(min(S, a)) 
is continuous). Since Ei(min(E, A)) = 1, we can set £ := min(S, A). □ 

Game-theoretic probability is a special case of game-theoretic expecta- 
tion, and in this special case it is possible to replace lim inf not only by 
limsupjj^^ but also by sup„, provided we restrict our attention to positive su- 
permartingales (simple examples show that this qualification is necessary). By 
Lemma [4j the definition of conditional upper probability P can be rewritten as 

V(E | s) := inf {S(s) | lim inf S(u n ) > 1 for all uj e E n Y(s)\ , (15) 

S ranging over the positive supermartingales. 

Lemma 6. The definition of upper probability will not change if we replace the 



liminfn-^oo in (15) by limsup^^^ or by sup K 



It is obvious that the definition will change if we replace the liminfn^oo by inf„: 
in this case we will have 



if E n r(s) = 

1 otherwise. 



F(E | s) 

Proof of Lemma [6| It suffices to prove that the definition will not change if 



we replace the lim inf n _j.oo in (15) by sup„. Consider a strategy for Skeptic 
resulting in a positive capital process. If this strategy ensures sup„ JC n > 1 when 
X1X2 ... £ En r(s) (it is obvious that it does not matter whether we have > or 



> in (15)), Skeptic can also ensure liminf„_ i . 00 tC n > 1 when X1X2 ■ ■■ € ECiT(s) 
by stopping (i.e., always choosing /„ identically equal to his current capital) 
after his capital K. n exceeds 1. □ 

Remark. The basic notion of this article is that of a bounded below super- 
martingale; in particular, upper and lower expectation and probability are 
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defined in terms of bounded below supermartingales. To define the latter it 
would be sufficient to start, instead of outer probability contents, from func- 
tionals T that satisfy Axioms [T]^4] and whose domain consists of the functions 
in M. x that are bounded from below. To see that no generality is lost when 
one starts from outer probability contents, it is sufficient to check that any such 
T can be extended to an outer probability content. One possible extension is 
£{f) := lim a _ ) ._ 00 J r (max(/, a)). Axioms [TJ|4] are easy to check for £ ; e.g., Ax- 
iom [3] follows from the inequality max(/ + g, 2a) < max(/, a) + max(g, a) and 
Axiom [3] for T: 

£(f + g) = lim 7 r (max(/ + g, a)) = lim J r (max(/ + g, 2a)) 

a— 00 a— 00 

< lim J r (max(/, a) + max(<?, a)) < lim (J r (max(/, a)) + J r (max(g, a))) 

a—)- — 00 ' a— V — 00 

= lim J-(max(f, a)) + lim J(max(j, a)) = £(f) + £(g)- 

a— >— 00 a— 00 

It is also easy to check that £ will be a superexpectation functional whenever 
J 7 is a superexpectation functional. 



4 Levy's zero-one law 

The following simple theorem is our main result. 

Theorem 2. Let £ : — > (—00, 00] 6e bounded from below. For almost all 

liminflff I w n ) > (16) 

This theorem is a game-theoretic version of Levy's zero-one law. Its name 
derives from its well-known connections with various zero-one phenomena, some 
of which will be explored in the next section and Section [H] 

Proof of Theorem Q This proof will be similar to the proof of Theorem [T] in 
that it will be based on the idea used in the standard proof of Doob's martin- 
gale convergence theorem. However, this idea will be applied in a less familiar 
mode ( "multiplicative" rather than "additive" ) , and so before giving a detailed 
proof we explain the intuition behind it making the simplifying assumption that 
£1, £2, ■ ■ ■ are superexpectations. 

By Lemma [6j it suffices to construct a positive supermartingale starting 



from 1 that is unbounded oaweSl for which ( 16 ) is not true. (We say that a 
supermartingale is unbounded on a sequence uj if it is unbounded on its prefixes 
Lu n as n — > 00.) Without loss of generality we will assume £ to be positive (we 
can always redefine £ := £ — inf £). According to Lemma|5] (last statement), we 



can, without loss of generality, replace "for which ( 16 ) is not true" by 



liminf E(£ | w n ) <a<b< £(w) (17) 

71— >00 

where a and b are given positive rational numbers such that a < b. The su- 
permartingale is defined as the capital process of the following strategy for 
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Skeptic. Let u £ fl be the sequence of moves chosen by World. Start with 1 
monetary unit. Wait until E(£ | id n ) < a (if this never happens, do nothing, 
i.e., always choose constant /„ = /C„_i). As soon as this happens, choose a 
positive supermartingale 1S1 starting from a, Si(ui n ) = a, whose upper limit 
^efi4 limsup^^,^ <Si(V> m ) exceeds £ on T(uj n ). Maintain capital S\/a until 
Si reaches a value mi > b (at which point Skeptic's capital is mi/a > b/a). 
After that do nothing until E(£ | u") < a. As soon as this happens, choose 
a positive supermartingale 52 starting from a, S2((d n ) = a, whose upper limit 
exceeds £ on T(u> n ). Maintain capital (mi/a 2 )S2 until S2 reaches a value rri2 > b 
(at which point Skeptic's capital is mim 2 /a 2 > (b/a) 2 ). After that do nothing 
until E(£ I uj n ) < a. As soon as this happens, choose a positive supermartingale 
1S3 starting from a whose upper limit exceeds £ on T(u} n ). Maintain capital 
(mim,2/a 3 )S3 until S3 reaches a value m 3 > b (at which point Skeptic's capital 



is mim 2 m 3 /a 3 > (b/a) 3 ). And so on. On the event (17) Skeptic's capital will 
be unbounded. 

We start the formal proof by setting £' := £ — C, where C is any constant 
satisfying C < inf £. Let [aj, i = 1,2, . . ., be an enumeration of all intervals 
with < a. L < bi and both end-points rational. For each i we will define a 
positive supermartingale S z with <5> J (D) = 1 such that S l (tu n ) converges to 00 
as n — > 00 when 

liminf !(£' I u n ) <a t <b t < g(w) (18) 

n— >oc 

(cf. (17)). First we define two sequences of cuts ctqj a ii °2j ■ ■ ■ an d T l: T 2, ■ ■ ■ and 

a " 
set 



family of supermartingales S s , s £ U^L^l- Set ctq := {□}. For k = 1,2, 



Tjj := {s I E(£' I s) < Oi,3t C s :i € 4-i>Vw G (t,s) : E(£' | u) > aj, 

choose for each s £ & positive supermartingale S, satisfying <S s (s) < dj and, 
for all to £ r(s), lim inf„ S s (id n ) > and set 

4 := {s I 3t C s : * e r|,«S 4 (s) > 6, ; ,Vw € (t,s) : $(«) < 

This definition is inductive: the two cuts and the family of supermartingales 
are defined in the indicated order: first <Tq, then tJ, then S s for s 6 t}, then 
er^, then t 2 , then S s for s £ r|, then cr^, etc. Now we define <5>* inductively. Set 
6> J (D) := 1. For all situations s and all x £ X, define S l (sx) via S z (s) as follows: 

• First suppose that S l (s) < 00 and, for some k £ N, s £ [t|,ct|.). Let fc 
be the unique value satisfying s £ [ T l^ a k)- Set t :— s T >* and S i (sx) :— 
S z (s)S t (sx)/S t ( S ). 



Otherwise, set S l (sx) := S l (s). 



Since each S s is a supermartingale (strictly positive, by Lemma [I]), Axiom [2] 
shows that S z is also a supermartingale. It is positive by construction. 

Let us check that each supermartingale S z satisfies lim sup,„ S l (u> n ) = 00 for 



W £ fi satisfying (18). For all k £ N and all id satisfying (18), uj' Tk exists and 
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satisfies 

S> CT *) = ^^ > wjfl 1 > ( bi / ai f oo (19) 

as k — > oo. Setting 

oo 

T := ^ 

i=l 

and assuming that £\, £2, ■ ■ ■ are superexpectations, we obtain a positive super- 
martingale T with 7~(n) = 1 that is unbounded on the complement of ( 16 ). Ap- 
plication of Lemma [6] completes the proof under the assumption that £\ , £2, ■ . ■ 
are superexpectations. 

It remains to get rid of the assumption. To this end we modify the definition 
of the supermartingales S s : now in each situation s G X* we fix a strictly 
positive supermartingale S s such that S s (s) < E(£' | s) + 2~' s l and, for all oj € 
r(s), liminf n S s (u n ) > This definition does not depend on i anymore. 

Using the new definition of S s , define stopping times o\.-,T l k , supermartingales 
S l , and a function T as before. For each j g N set 

Ai := {s e X* I S\s) < 00, 3k € N : s € [t£, 4)} 

(this is the set of situations in which 6> J is "active"), and for each s G A; set 
T(s,i) := s Tfc , where fe satisfies s € [t^, cj^) (there is only one such fc). 

Fix an arbitrary situation s € X"^ 1 , for some n € N; our next goal is to 
prove £ n (T(s-)) < T(s). Setting, for t C s, 

w t := E 2~\S l (s) e [0,oo], 

ieN:seAi,T(s,i)=t 

we have 

r(-s)=f;2-*$V)= £ 2-*5*(.)^ M ^+ £ 2"^( S ) 

i=l iisgi, r(a,i)k ) i, s £ At 

which implies, since the sum X)tc s * s finite (namely, contains \s\ + 1 addends), 

£„(T( S .)) = E^^7^+ E 2 ~^(*) 



St(s) 

tCs 

Therefore, T is a supermartingale 
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Notice that (19) will still hold for u> satisfying (18) if we replace (bi/ai) k by 



n 



=1 a, + 2-l" Tj l 



(20) 



since |w t j | — > oo as j — > oo, the product (20) still tends to oo as k — > oo. 
Therefore, T is unbounded on the complement of (16). □ 

In the rest of the article we will derive a series of corollaries from Theorem [51 
First of all, specializing Theorem [2j to the indicators of events, we obtain: 

Corollary 2. Let E be any event. For almost all w G E . 

¥(E | co n ) -> 1 



as n — > oo. 

It is easy to check that we cannot replace the > in ( [l6| by =, even when £ 
is the indicator of an event. For example, suppose that X = {0, 1} and each £ n 
is the sup functional: £ n {f) - = s ^P x ex 

f{x) for all n G N and / G R x . If E 
consists of binary sequences containing only finitely many Is, P(E | ui n ) = 1 for 
all to and n; therefore, 

liminfPCE | u n ) 
for all oj € £; c , and IP(£; c ) = 1. 



The case of a determinate expectation or probability 

In Section 41 of (pp. 128-130), Levy states his zero-one law in terms of a 
property E that a sequence X\ , X 2 , . . . of random variables might or might 
not have. He writes Pr.{E} for the initial probability of E, and Pr n {E} for 
its probability after Xi,. . . ,X n is known. He remarks that if Pr.{E} is well 
defined (i.e., if E is measurable), then the conditional probabilities Pi n {E} are 
also well defined. Then he states the law as follows (our translation from the 
French) : 

Except in cases that have probability zero, if Pi.{E} is deter- 
mined, then Pr n {E} tends, as n tends to infinity, to one if the se- 
quence Xi,X2, ■ ■ ■ verifies the property E, and to zero in the con- 
trary case. 

In this subsection we will derive a game-theoretic result that resembles Levy's 
statement of his result. We will be concerned with functions £ satisfying E(£) = 
E(£) and events E satisfying ¥(E) = ¥(E). 

Lemma 7. Suppose £±,£2, ■ ■ ■ are superexpectations. Let a junction £ : Q — > M 
satisfy E(£) = E(£) G K. Then it is almost certain that it also satisfies E(£ | 
uj n ) = E(£ I uj u ) for all n. 
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Proof. For any strictly positive e, there exist bounded below supermartingales 
Si and 6>2 such that 

Sx(a) <E(£)+e/2, S 2 (□)<!(-£) +e/2 

and, for all we!!, 

liminf Si(u n ) > fa), liminf <S 2 (cj") > 

Set 5 := Si + <S 2 . The assumption E(£) = E(£) € K can also be writ- 
ten E(£) + E(— £) = 0. So the supermartingale 5 satisfies £>(□) < e and 
liminf n^oo S(uj n ) > for all u) £ fi; by Lemma [I] the supermartingale 5 is 
positive. 

Fix n and £ > 0, and let E be the event that 

E(£ | uj n ) +E(-£ | w n ) > 6. 

By the definition of conditional upper expectation, 

5i(w n ) > E(£ | w n ) and 5 2 (w") > E(-£ | u"). 

So S(ui n ) > S for all uj e E. So, by Lemma |6| the upper probability of E is 
less than e/5. Since e may be as small as we like for fixed 5, this shows that E 
has upper probability zero. Letting 8 range over the strictly positive rational 
numbers and n over {0, 1,2,.. .} and applying the last part of Lemma [5] we 
obtain the statement of the lemma. □ 

Corollary 3. Suppose £i,£ 2) ... are superexpectations. Let £ : Q — > M. be a 
bounded function for whichE,^) — E(£). Then, almost surely, E(£ | u n ) = E(£ | 
uj n ) — > £(uj) as n — > oo. 

Proof. By Theorem [2] 

liminf E(£ | w") > £(u>) 

n— >oo 

for almost all to 6 SI and (applying the theorem to — £) 

limsupE(f | cj" ) < £(cj) 

for almost all to € CI. □ 

Our definitions Q make it easy to obtain the following corollary for events. 

Corollary 4. Suppose Ei , £ 2 , • ■ ■ are superexpectations. Let E be an event for 
which ¥(E) = V(E). Then, almost surely, V(E | u n ) = V(E | w n ) -> I £ as 
n —> 00. 
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5 An implication for the foundations of game- 
theoretic probability theory 

Let £ : £1 — > K be a bounded function, and let s := □. We will obtain an 
equivalent definition of the upper expectation E(£ | s) = E(£) if we replace the 
phrase "for all uj E r(s)" in (6| by "for almost all u € fi". It turns out that 
if we do so, the infimum in (16) becomes attained; namely, it is attained by the 
supermartingale S(s) :— E(£ s), s E A"*. (This fact is the key technical tool 
used in [ID].) In view of Theorem [5] to prove this statement it suffices to check 
that S is indeed a supermartingale (it will be bounded below by Lemma [I]). We 
will prove a slightly stronger statement. 

Lemma 8. Let £ : — > R. Then S := E(£ | •) is a martingale. 

Proof. First we check that S is a supermartingale. Let n e N, s E Af™ -1 , 
and r > <S(s). By Lemma [4] there exists a bounded below supermartingale T 
such that T(s) < r and liminf„T(w") > £(w) for all w e fi. Then we have 
S{sx) < T(sx) for all x € X, and so we have 

£ n (S(s-))<8 n (T(s-))<T(s)<r. 

Letting r — > S(s) (if S(s) < oo) shows that £ n (S(s ■)) < S(s), which proves the 
supermartingale property. 

It remains to prove S(s) < £ n (S(s-)) when n E N and s E X n ~ 1 . Let 
e > 0. For each x E X choose a bounded below supermartingale S sx satisfying 
f(sx) := S sx (sx) < S(sx) + e and liminf„ S sx (uj n ) > £(w) for all lo E T(sx). 
Define a bounded below supermartingale S s by 

if sx C t for some x E X 
Sjl):= {fjflS-)) if t = S 

otherwise. 

Since S s (s) < £ n (S(s •)) + e and liminf„ S s (ui n ) > £(w) for all to E T(s), we have 
S(s) < £ n (S(s •)) + £■ Let e 0. □ 

The following simple example shows that replacing "for all u E r(s)" in (|6| 
by "for almost all w G f2" is essential if we want the infimum to be attained. 

Example 2. Consider the coin-tossing protocol, as in Example [T] Let A be the 
set of all u> E fl containing only finitely many Is, let £ := 1^, and let s := □. 
The infimum in Q is not attained: there exist no supermartingale S satisfying 
5(D) = 1(0 and liminf^oo S(uj n ) > ((u) for all ui E tt. 

Proof. By Lemma [T] such an S would be positive. Let L be the uniform 
probability measure on {0, 1}°° equipped with the Borel a-algebra. Since 
¥{E) = L(E) for all Borel sets in {0,1}°° {8\, Proposition 8.5), we would 
have iS(D) = E(£) = 0. A positive supermartingale with initial value in the 
coin-tossing protocol must be a constant. □ 
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6 More explicit zero-one laws 

In this section we will deduce two corollaries from our game-theoretic version of 
Levy's zero-one law: Kolmogorov's zero-one law and the ergodicity of Bernoulli 
shifts. Both corollaries were proved in [9] directly. These two results are more 
general than the corresponding measure-theoretic results; see [5], Section 8.1, 
for relations between measure-theoretic results and their game-theoretic coun- 
terparts. 

For each N € N, let Tn be the set of all events E that are properties of 
(w/v, Wjv+i) ■ ■ •) only (i.e., E such that, for all u>, u/ € f2, (J £ E whenever lu 6 E 
and ui' n — LJ n for all n > N). By a tail event we mean an element of rijv^jv- 
In other words, an event E C is a tail event if any sequence in f2 that agrees 
from some point onwards with a sequence in E is also in E. 

Kolmogorov's zero-one law 

Levy's zero-one law immediately implies the following game-theoretic version of 
Kolmogorov's zero-one law. 

Corollary 5 ([9 ). For all tail events E C fl, ¥(E) £ {0, 1}. 

Proof. First we will check that, for each N € N and each E € J-jy, P(JS | s) does 
not depend on s e X N ~ l . Indeed, let s,t € A"^ 1 and P(£ | s) < r. Choose 
a bounded below supermartingale S such that S{s) < r and liminf n <S(a; n ) > 
Ie{w) f° r a ll ^ € r(s). We will write a& for the concatenation of two situations 
a e A"* and b £ X* , and ato for the concatenation of a £ X* and a; e 57. The 
supermartingale 




S(sv) if u = tv for some (uniquely determined) v £ X* 
oo otherwise 



witnesses that P(i? | t) < r, in the sense that S'(t) = S(s) < r and, for all 
uj £ Q, 

liminf 5'(tcj") = liminf «S(sw n ) > I B (sw) = 

n n 

Since this is true for all s,t £ X N ~ 1 1 ¥(E | s) cannot depend on s £ X N ^ X . 

By Lemma |8] and Axiom [5] this implies P(£ | cj^" 1 ) = P(J5) for N £ N, 
S € -Fat, and w e fl. By Corollary [2j for E £ J 7 we have P(15) = 1 for almost 
all lo £ E, which is equivalent to P(£?) € {0, 1}. □ 

We say that an event E is fully unprobabilized if V(E) — and P(£ l ) = 1. 
Since complements of tail events are also tail events, we obtain the following 
corollary to Corollary [5] 

Corollary 6 ([9]). If E C f2 is a tail event, then E is almost certain, almost 
impossible, or fully unprobabilized. 
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Ergodicity of Bernoulli shifts 

In this subsection we consider a special case of Protocol 1 where £\ — £2 = ■ ■ ■ ■ 
We write 9 for the shift operator, which deletes the first element from a sequence 
in X°°: 

9 : xix 2 x 3 . . . H> X2X3 

We call an event E C O weakly invariant if 9E C E. In accordance with 
standard terminology, an event E is invariant if E = 9~ X E. 

Lemma 9. An event E is invariant if and only if both E and E c are weakly 
invariant. 

Proof. We will give the simple argument from [SJ. If E is invariant, then E c is 
also invariant, because the inverse map commutes with complementation. Hence 
in this case both E and E c are weakly invariant. 

Conversely suppose that 9E C E and 9E C C E c . The first inclusion is 
equivalent to E C 9~ 1 E and the second is equivalent to E c C 9~ 1 E C . Since the 
right-hand sides of the last two inclusions are disjoint, these inclusions are in 
fact equalities. □ 

The following corollary asserts the ergodicity of Bernoulli shifts. 

Corollary 7(9). Suppose £\ = £2 = • • • . For all weakly invariant events E, 

P(£0e{O,i}- 

Proof. For any weakly invariant event E and any situation s, F(E \ s) < P(E). 
Indeed, let P(E) < r. Choose a bounded below supermartingale S such that 
S(0) < r and liminf n S(uj n ) > Ie(w) for all w 6 O. Define a new bounded 
below supermartingale S' by S'(st) :— S(t) for all t £ X* and S'(t) := 00 for 
all t e X* such that s % t. This supermartingale witnesses that ¥(E \ s) < r, 
in the sense that S'(s) = S(D) < r and 

Ummf5'(sw n ) = liminf S(cu n ) > I B (ui) > I e {slo), Vw G 0, 

n n 

the last inequality following from sui € E u) € E '. 

Therefore, we have V(E \ ui n ) < P(E) when E is weakly invariant. By 
Corollary [2j for almost all u e E it is true that F(E) = 1. Therefore, F(E) is 
cither or 1. □ 

In view of Lemma [9] we obtain the following corollary to Corollary [7] 

Corollary 8 ([9]). Suppose £ 1 = £ 2 = • • • . If E is an invariant event, then E 
is almost certain, almost impossible, or fully unprobabilized. 

Since each invariant event is a tail event, Corollary [8] also follows from Corol- 
lary [6] 
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7 The generality of the basic prediction protocol 



Let E(X) be the set of all outer probability contents on a set X. Protocol 1 is 
a special case of the following apparently more general protocol. 

Protocol 2. Prediction protocol with Forecaster 
Parameters: non-empty set X, non-empty sets V\,V2, ■ ■ ■ , 

and function £ : p 6 U n V n h-> £ p € E(A?) 
Protocol: 

Skeptic announces /Co G K. 
FOR n= 1,2,...: 

Forecaster announces p n G V n . 

Skeptic announces f n such that £ Pn (f n ) < A^n-i- 

Reality announces x n £ X . 

K-"n ■ fn y^n ) • 

END FOR 

As compared with Protocol 1, Protocol 2 involves another player, Forecaster; 
World is now called Reality. (We will see later that another interpretation is 
that World is split into two players: Reality and Forecaster; cf. jS], p. 90.) At the 
beginning of each trial Forecaster gives his prediction p n for Reality's move x n ; 
the prediction is chosen from a set V n , the prediction space for trial n. We will 
use the notation V for U n P n . After Forecaster's move Skeptic chooses a gamble, 
which we represent as a function f n on X: f n {x) is the payoff of the gamble if 
Reality chooses x as the trial's outcome. The gambles available to Skeptic are 
determined by Forecaster's prediction (via the function £ : V — > ~E(X)). 

Protocol 1 is a special case of Protocol 2 obtained by taking distinct one- 
element sets V\ , V2 , ■ ■ ■ ■ In some sense Protocol 1 describes independent trials 
(since £\, £%,... are given in advance) whereas Protocol 2 describes dependent 
trials (Forecaster has a say in choosing £ pi , £ P2 ,...). 

Remark. Another version of the prediction protocol with Forecaster is where 
Forecaster chooses the superexpectation functional directly. This is a special 
case of our protocol with V n — E(Af) for all n and with £ : V — > E(A') the 
identity function. The reader will also notice that allowing £ to depend not 
only on Forecaster's last move but also on his and Reality's previous moves 
is straightforward but does not lead to stronger results: the seemingly more 
general results easily follow from our results. 

We call the set SI := n^LiC^ 5 ™ x of all infinite sequences of Forecaster's 
and Reality's moves the sample space. The elements of the set IJ^Lq rii=iC^» x 
X) of all finite sequences of Forecaster's and Reality's moves are called clearing 
situations, and the elements of the set U^Lo (II"^^* x X) x V n +i) are called 
betting situations. We will be mostly interested in clearing situations. For each 
clearing situation s we let T(s) C SI stand for the set of all infinite extensions 
in S7 of s and let □ be the empty clearing situation. 

The level \s\ of a clearing situation s is the number of predictions in s. In 
other words, n is the level of clearing situations of the form p\X\. . .p n x n . If 
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ui £ il and n E {0, 1, . . .}, cj" is defined to be the unique clearing situation of 
level n that is a prefix of u). 

A function S defined on the clearing situations and taking values in K is 
called a supermartingale if, for each n £ N, each clearing situation s at level 
n — 1, and each p G V n , 

£ p (5( S p-))<5( S ). 

For each function ^ : O — ^ 1R and each clearing situation s, we define the 
(conditional) upper expectation of £ given s by the same formula (jfjj), where 5 
ranges over the supermartingales that are bounded below, and we define the 
lower expectation of £ given s by Q. 

Lemma 10. Theorem^ and, therefore, Corollary^ continue to hold under the 
definitions of this section. 

Proof. Protocol 2 can be embedded in Protocol 1 as follows. Let the parameters 
of Protocol 2 be X, Vi,V%, ■ ■ ., and £; as before, V := U n V n . For each n e N, 
define an outer probability content £ n on X' := V x X by 



£„(/):= sup £ p (/(p,-)), /:#' 



(Axioms [TJ|4] are easy to check for £ n ; e.g., Axiom [3] follows from sup(/ + g) < 
sup / + sup g.) The parameters of Protocol 1 will be X' and £1,82, 



Our goal is to prove (16) in Protocol 2. Let £ : Q — ¥ (—00,00] be bounded 
below. To each to in the sample space fl of Protocol 2 corresponds the same 
sequence in the sample space fi' := (X')°° of Protocol 1; therefore, fi C O' 
(perhaps ft c £!')• Let £' : 0' — > (—00, 00] be the extension of £ defined by, say, 
£'(w) := for u> £ ft. Since the analogue 

liminf !(£' I w") > £'(w), for almost all oj e Ct', 



of (16 1 holds in Protocol 1, we are only required to prove two statements: 



1. E(£ I u) n ) > E(C I u n ) for all w £ fl and n = 0, 1, . . ., where the E on the 
left-hand side refers to Protocol 2 and the E on the right-hand side refers 
to Protocol 1. 

2. If an event E C 0' is null in Protocol 1, E nil will be null in Protocol 2. 

First we prove Statement 1. Fix uj £ fi and n G {0,1,...}. For each 
e > there is a bounded below supermartingale S in Protocol 2 such that 
5(w n ) < !(£ I w") + e and liminf n ->oo «5(a; n V) > for all ^1 6 fi. Let 

5' be the extension of S to (A")* defined as 00 on the situations in Protocol 1 
that are not clearing situations in Protocol 2. By the definition of £ n , S' will be 
a supermartingale in Protocol 1: if s is a clearing situation in Protocol 2 (the 
case where it is not is trivial), we have 

£ n (S(s-))= sup £ p (S(sp-)) < sup S(s)=S(s), 
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where n = \s\ + 1. The supermartingale S' witnesses that E(£' | u") < E(£ | 
uj n ) + e: indeed, we have lim inf m _ i . 00 S'{u n ijj m ) = liminf TO _ i . 00 5(aj"?/; m ) > 
^(ui n tp) = £'(u) n ip) for ijj £ fl since S' is an extension of S and £' is an extension 
of £, and we have liminf m _ ) . 0O S'(u"f) = oo > = £'(w n V0 for %fj £ W \ Q 
since in this case w ra 'i/ ,m is n °t a clearing situation in Protocol 2 from some m 
on. Setting e — ► completes the proof of Statement 1. 

To prove Statement 2, it suffices to check that for any supermartingale S' 
in Protocol 1 its restriction to the clearing situations in Protocol 2 will be a 
supermartingale in Protocol 2. This follows immediately from the definition of 
E\, £2, ■ ■■ if n £ N, s is a clearing situation at level n — 1, and p € "P„, 

£ P (5'(sp •)) < sup £ p (S'(sp •)) - £n (S'(s •)) < S'(s) 

p£V n 

(the first two • stand for an element of X and the last • stands for an element 
of A"). □ 



Notice that Theorem [2] is a special case of Lemma 10 corresponding to 



distinct one-element sets Vi,V2, ■ ■ ■ in Protocol 2. The argument in the proof 



of Lemma 10 (which is due to a referee) demonstrates that Protocols 1 and 2 



are essentially equivalent. 



8 Bartfai and Revesz's zero-one law 

In this section we will deduce a game-theoretic analogue of a zero-one law [l] 
for dependent random variables. Intuitively, the role of the sample space will 
now be played by the set X°° of all moves by Reality, and the role of situations 
will be played by elements of X* . If x = X1X2 ■ ■ ■ € X°° , we let Xn stand for 
x n £ X for n £ N, and let x™ stand for x\ . . . x n £ X n for n £ {0,1, . . .}. 

A forecasting system <& is any function $ : X * —> V such that (j>(x n ~ 1 ) € V n 
for all x € an d n £ N. A forecasting system can serve as a strategy for 
Forecaster in Protocol 2, giving Forecaster's move as function of Reality's moves. 
For each x G X 00 define 

X* := 3 > (°)X1*(X 1 )X2$(X 2 )X3 ...6fi. 

For each £ C A" 00 define := {x* I X e £}. For £ C X°° , X € A" 00 , and 
n G {0, 1, . . .}, set 

P*(£ I X n ) ■■= HE* I (**)"), P*(£ I x") := 1 - P*(£ c I x")- 

As before, " | □" may be omitted, so that P$(£) = ¥(E$) and P^E 1 ) = P(£$). 
An £ C A" 00 holds ^-almost surely ($-a.s.) if = 0. 

For each AfeN, let F N be the set of all E £ X°° such that, for all x, x' € 0, 

(X £ E,Vn > N : x' n = Xn) => x' € 
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Let us say that a forecasting system 3> is 6-mixing, for 5 G [0, 1), if there exists 
a function a : N — > N such that 



M-E I X n ) - P*(£) < <* *-a.s. (21) 

for each n G N and each i? G ^F n +a(n)- By a tai/ set we mean an element 
of HnJ^n- Now we can state an approximate zero-one law, which is a game- 
theoretic analogue of the main result of [T] . 

Corollary 9. Suppose £ p is a superexpectation for all p G V . Let 6 G [0, 1) and 

let $ be a S -mixing forecasting system. If E C X°° is a tail set, then P$(_B) = 
orV^(E) > 1-5. 



Proof. Fix a tail set E C X°°\ (21) then holds for all n. By the last part 
of Lemma [5] (which is also valid in Protocol 2), there is A C X°° such that 
P*(A) = and 

P$(£ I X") -P*(E) < <5 (22) 



holds for all n and all x ^ A. By definition, (22) means 

P(^|(x*) n )-5P(^)<* (23) 
By Corollary [2] and Lemma [l0| there is a set B C Q such that P(B) = and 

P(S$ I w n ) 1 (n 00) (24) 



for all G -E$ \ £>. Letting n — > 00 in (23) and using (24), we can see that 
P(£$) > 1 - 6 (i.e., P$(£0 > 1 - 5) for all x such that x i A (i.e., x* £ A ) 
and x$ G ^* \ -B- 

Suppose P 4.(2?) > 1 — S is violated. Then there are no \ satisfying x$ ^ A^ 
and x$ G -E$ \ B. In other words, 2J$ \B C A$, which implies £7$ C A$ U i?, 
which in turn implies W(E$) = 0, i.e., ¥${E) =0. □ 

Let us say that a set E C A" 00 is $ -unprobabilized if P$(i?) < P$(-E). An 
important special case of Corollary [9] is the following zero-one law for "weakly 
dependent" trials (cf. Corollary 1 in pQ). 

Corollary 10. Suppose £ p is a superexpectation for all p G V . Let 5 G [0, 1/2) 
and let <I> be a 5-mixing forecasting system. Every tail set E C X°° satisfies 
¥§(E) = I, satisfies ¥$(E) = 0, or is $ -unprobabilized. 

Proof. It suffices to apply Corollary [9] to the tail sets E and E c . □ 

It is easy to strengthen Corollary [9] by modifying the notion of a 5-mixing 
forecasting system. Let us say that the forecasting system is asymptotically 5- 



mixing, for 5 G [0, 1), if (21 ) holds for each n G N and each tail set E. Bartfai and 
Revesz [T| do not introduce this notion (more precisely, its measure-theoretic 
version) explicitly, but they do introduce two notions intermediate between 
^-mixing and asymptotic (5-mixing, which they call stochastic 5-mixing and 5- 
mixing in mean. The following proposition is similar to (but much simpler than) 
Theorems 2 and 3 in pQ. 
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Corollary 11. Suppose £ p is a superexpectation for all p 6 ?. Let 6 € [0,1). 
The following two conditions are equivalent: 

1. A forecasting system is asymptotically 6 -mixing. 

2. Every tail set E C X°° satisfies P*(JB) = or ¥^(E) > 1 - S. 

Proof. The argument of Corollary [9] shows that the first condition implies the 
second. Let us now assume the second condition and deduce the hrst. Let neN 
and E be a tail set. If F$(E) = 0, then F$(E \ \ n ) = $-a.s. can be proved 
similarly to the proof of Lemma [7j and so (21 ) holds. If P$(i?) > 1 — 5, (21 1 is 



vacuous. □ 
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